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Summary 

Finite  parameter  models  of  ARMA  type  have  been  used  extensively  in 
many  applications.  Under  the  usual  Gaussian  assumption,  the  second 
order  analysis  will  not  be  able  to  discriminate  among  competing  models 
which  give  the  same  correlation  structure.  In  many  applications  the 
Innovation  process  is  non-Gausslan.  In  this  case,  analysis  using 
higher  order  moments  will  identify  the  model  uniquely  without  the 
usual  invertibllity  assumption.  This  in  turn  will  affect  the  fore¬ 
casting  based  on  the  non-Gausslan.  model.  We  present  a  method  which 
uses  blspectral  analysis  and  the  Pade  approximation.  We  show  that  the 
method  will  consistently  Identify  the  order  of  the  ARMA  model  and 
estimate  the  parameters  of  the  model.  One  could  also  deconvolve  the 
process  to  estimate  the  innovation  process  aich  will  provide  infor¬ 
mation  for  possible  more  efficient  maximum  likelihood  estimation  of 
the  parameters.  Asymptotic  distributions  are  given,  and  a  few  ex¬ 
amples  are  presented  to  Illustrate  the  effectiveness  of  the  method. 
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1.  Introduction 


Finite  parameter  autoregressive  moving  average  models  have  been 
used  extensively  In  time  series  modeling,  forecasting  and  control. 

Most  of  the  literature  Is  concerned  with  Gaussian  processes.  Let  ran¬ 
dom  variables  efc,  t  -  ...,-1,0,1,...  be  Independent  and  identically 
distributed  with  mean  zero.  Be  -  0,  and  variance  one  Be  "1.  Let 
{a. }  be  a  sequence  of  real  constants  with 

J 


us<-  ■ 


Consider  the  linear  process  generated  by  {a  }  and  {e  } 

J 


a  e 

.  jt-j 


The  frequency  response  function  Is  given  by 


(1.1) 


A(e“1X)  -  Ea.e"iJX  .  (1.2) 

J  3 

If  the  process  Is  normally  distributed  then  Its  full  probability 
structure  Is  completely  determined  by  its  spectral  density  function 

f(X)  |A(«"1X)|2  .  0-3) 

Hence  the  phase  information  In  A(e  iX)  is  not  Identifiable  In  the 
Gaussian  case.  If  A(z)  Is  a  rational  function 

A(s)  -  Qq(*)/Pp(s)  (1.4) 

with 


0  i 

Q_(*)  -  E  q.s  qft  *  0 

q  1-0  1  0 


P  (*)  - 
P 


P 

E  P, 
1-0 


P0" 


(1.5) 
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then  we  say  that  the  process  {x^}  satisfies  a  finite  parameter  auto¬ 
regressive  moving  sverage  model  or  simply  ARMA(p,q) .  Usually  we  write 

P  (B)X..  -  Q  (B)e  (1.6) 

P  t  q  t 

where  B  is  the  backshift  operator.  There  are  two  related  problems  to 
be  considered  here.  The  first  is  to  determine  the  orders  of  the  poly¬ 
nomials  P  (z)  and  Q  (z).  This  is  the  model  identification  problem. 

P  <1 

The  second  is  the  problem  of  estimating  the  coefficients  in  P^(t)  and 

Q  (z)  after  the  model  is  identified.  Given  a  model  of  the  form  (1.6), 
1 

most  of  the  literature  assumes  that  P  (z)  and  Q  (z)  have  no  root  on 

P  <1 

the  unit  disk,  |z|  <  1.  The  condition  P^(z)  *  0  for  all  |z|  <  1  is 
called  the  realizability  condition  so  that  Xfc  has  a  one-sided  infinite 
moving  average  representation 


with 


X  -  A(B)e  -  I  a  e 

'  3-0  3  3 


(1.7) 


A(B) 


Z  a  BJ 

j-0  3 


This  is  the  same  as  saying  a  «  0  for  all  j  <  0  in  (1.1).  The  condi- 

•# 

tion  Qq(*)  *  0,  | z |  <  1,  called  the  invertlblllty  condition,  is  not 

needed  for  statlonarity.  If  {Xfc}  satisfies  (1.6)  and  is  a  Gaussian 

process  then  it  is  well  known  that  any  real  root  r.  #  0  of  P  (z)  or 

j  P 

Qq(z)  can  be  replaced  by  its  Inverse  rj1  and  paired  conjugate  complex 
roots  can  be  replaced  by  their  conjugated  Inverses  1  without  chang¬ 
ing  the  correlation  structure  of  {xt}.  This  means  that  if  all  the 
roots  are  real  and  distinct  then  there  are  2^+^  different  ways  to 


specify  the  roots  and  they  are  indistinguishable  by  examining  the 
autocorrelation  function.  Since  different  set  of  roots  correspond  to 


different  eet  of  coefficients,  it  le  cuetoaary  to  assume  that  all 

rooti  of  P  (z)  end  Q  (z)  ere  outelde  the  unit  circle  end  to  eatinete 
P  1 

the  coeffidente  of  P  (z)  end  Q  (z)  under  thie  condition.  He  will 

P  fl 

preeent  e  aethod  thet  cen  be  applied  without  laposlng  the  invertibil- 
ity  aaeunptlon. 

There  are  various  procedures  in  the  literature  concerning  the 

identification  of  the  orders  p  of  P  (z)  and  q  of  Q  (z).  Most  of  these 

P  9 

procedures  Involve  the  exaalnatlon  of  the  residuals  or  estimates  of 
e^'s.  In  doing  so,  lnvertlblllty  is  assuned.  The  distribution  of  e£ 
is  assuned  to  be  Gaussian  or  a  known  one  so  that  aaxlaum  likelihood 
estlaation  of  the  ooeffldenta  can  be  carried  out.  Box  and  Jenkins 
[ 1976]  considered  an  iterative  procedure  by  examining  the  autocorrela¬ 
tion  function  and  partial  autocorrelation  function.  In  a  aeries  of 
papers,  Akalke  [1969,  1971,  1978)  proposed  a  final  prediction  error 
criteria  (FPE),  an  information  criteria  (AIC)  and  a  Bayesian  version 
of  it  (BIC).  These  methods  are  based  on  multiple  decision  procedure 
and  were  studied  by  others.  (See  Priestley  [1981]).  Hypothesis 
testing  methods  were  considered  by  Godfrey  [1979]  and  Poskltt  and 
Treaayne  [1980].  Gray,  Kelly  and  Hoodward  [1978]  considered  the  S 
Array  aethod  using  a  pattern  recognition  technique.  More  recently 
Hoodward  and  Gray  [1981]  proposed  e  generalized  partlel  autocorrela¬ 
tion  method.  Tiao  and  Tsay  [1981]  proposed  an  iterative  regreesion 
approach  baaed  on  extended  autocorrelation  function.  Hannan  and 
Rissanen  [1982]  considered  a  recursive  method  to  identify  an  ARMA 


model 


Parameter  estimation  methods  have  been  developed  by  Hannan 
[1969],  Box  and  Jenkins  [1976],  Anderson  [1977]  and  Ansley  [1979] 


If  the  process  {Xfc }  is  nonGaussian,  Hi  and  Rosenblatt  [1982] 

proved  that,  under  broad  conditions,  (1.2)  is  Identifiable  up  to  a 

sign  change  and/or  index  shift  of  the  a  *s  requiring  only  that  P  (z) 

j  P 

and  Qq(z)  have  no  root  of  absolute  value  one. 

It  has  been  observed  that  in  many  geophysical  and  economic  con¬ 
text  that  data  is  often  nonGaussian.  In  this  paper  we  propose  a 
method  to  identify  the  orders  p  and  q  of  the  model  (1.6)  and  estimate 
the  corresponding  coefficients  without  the  usual  lnvertibllity  assump¬ 
tion.  In  section  2  we  adopt  the  higher  order  spectra  method  proposed 
in  Rosenblatt  [1980]  and  Lil  and  Rosenblatt  [1982]  to  estimate  the 
a^'s  in  (1.7)  and  obtain  their  asymptotic  distributions.  In  section 
3  we  Introduce  C-table  and  the  Fade  table  and  give  a  method  to 
identify  the  model  and  to  estimate  the  underlying  parameters.  Asymp¬ 
totic  results  are  given.  Section  4  consists  of  a  few  examples  and  a 
discussion. 

2.  Asymptotics  of  the  higher  order  spectral  method 

Let  the  frequency  response  function  from  (1.2)  be 

1 

A(e"1X)  -  |2wf(l)|7  expfih(x)}  .  (2.1) 

There  are  many  references  concerning  the  estimation  of  the  spectral 
density  function  f(X).  (See  Anderson  [1971]  or  Jenkins  and  Watts 
[1968]).  Lil  and  Rosenblatt  [1982]  proposed  a  method  to  estimate  the 
phase  information  h(X)  when  the  process  X£  (and  hence  the  innovation 
process  e^)  is  nonGaussian.  Some  basic  results  from  this  paper  are 
summarized  in  the  following  lemmas. 


Le—  2.1.  Let  {x^}  be  e  nonGeueelen  llncer  process  given  In  (1.1) 
with  the  Independent  rendoa  variable  }  having  all  nonents  finite. 
Assuming  that 

i|j|  |.j|  <  - 

and 

A(e“1X)  *  0  for  all  X 
and 

h(0)  -  0  (2.2) 

Then  the  phase  h(X)  In  (2.1)  Is  given  by 

h( X)  -  hj(X)  -  Xhj(»)/*  +  aX  (2.3) 

where  a  Is  an  Integer  and 

hj(X)  -  /J  (h*(u)  -  h’(0))du  (2.4) 

with 

h*(0)  -  h'(X)  -  lla  7-4r7  fh(X)+(«-2)h(A)-h(X-K«-2)A)}  (2.5) 

A*0 

where  e>2  la  an  Integer  such  that  C^,  the  sth  order  cumulant  of  {Xfc } B 
Is  nonzero  and 

h(Xj)  +...+  hd^)  -  h(Xj  +...+  X^j) 

-  S1  k(li . W»  <2-‘> 

where  b(  •)  Is  the  »th  order  cumulant  spectral  density  of  the  process 
{X(}  discussed  In  Brllllnger  and  Rosenblatt  (1967). 

Remark  1.  Pro*  (1.2)  and  (2.1)  we  have 

1 

A(l)  -  laj  -  |2vf(0)|7  exp{lh(0) }  . 

Since  a^'s  are  real,  we  have  either  Ea^  >  0  or  Ea^  <  0.  The  assump- 
tion  h(0)  ■  0  in  Lems  2.1  represents  an  arbitrary  choice  of  the  signs 


6— 


of  •  Observing  X  *8  only,  the  signs  of  the  a  *8  ere  Intrinsically 

j  j 

undecldable  since  we  can  multiply  all  a^ 'a  and  e^'s  by  minus  one  with¬ 
out  changing  (1.1). 

The  Integer  a  In  (2.3)  la  intrinsically  undecldable  also  since  it 
corresponds  to  reindexing  the  X^'s. 

Remark  2.  However,  in  the  usual  normalisation  of  model  (1.6)  or  (1.7) 
we  assume  a0  >  0.  Under  this  assumption  we  can  use  Theorem  2.1  to  be 
proved  later  to  ascertain  the  first  nonzero  a^  and  shift  the  index  and 
adjust  the  sign  accordingly.  Without  loss  of  generality,  in  what  fol¬ 
lows,  we  will  assume,  that  m  -  3  in  order  to  illustrate  the  techniques 
of  the  method. 

Lemma  2.2.  Under  the  assumptions  of  Lemma  2.1.  An  estimate  of  hj(X) 


is,  from  (2.4  -  2.6), 


k-1 

H  (A)  -  -  £  arg  b  (JA,A) 

n  J-l  " 


(2.7) 


where  kA  -  A  and  it  is  understood  that  the  blspectral  estimates  b  (  •) 

n 

based  on  a  sample  of  size  n  are  weighted  averages  of  third  order 

2 

periodogram  values.  If  b(A,|i)  e  C  and  the  weight  function  W  is 
symmetric  and  band  limited  with  band  width  A,  then 


with 

and 


H  (A)  -  h,(A)  -  R  (  A)  +  o  (H  ( A)  -  h.(A)) 
n  i  n  p  n  i 

ER  (A)  -  AG(  A)  +  o( A) 
n 

Cov(R(A),R  (u))  -  f2(u)-  du 


A*n 


-  ,  min(X,w)  /  Wz(u,v)dudv 

AJnCz 


0  |b(u,0) 

J  V2(u,v)dudv 


(2.8) 


for  A(n)  ♦  0,  Azn  ♦  •  as  n  ♦  • 


where  G(A)  Is  a  function  Involving  b(A,  p).  Further  EH  (A.)  ♦  h, (A.) 

n  j  1  J 

end  H&(Aj)'e  are  asymptotically  jointly  normally  distributed  with  co- 
variances  given  by  (2.6). 

Since 


lJ  "  fi  K 


2w  -1A.  1JA., 
0  A(e  )e  J  dA 


an  estimate  a  of  a  is  given  by 

J  J 


*  1  f2w  -1An  1J  A 

aj  "  H  Jo  A(e  )e  dx 

1  M  -ir  H  ( ») 

-  £  ^E  (2vfn(Ak))^  e*p{i(Hn(Ak)  -  -~j—  Afc  +  J A^) }  (2.9) 

which  by  symmetry  can  be  written  as 


-  I*  v  H  (t) 

■  H  £  «'VV>  «"(VV  -  -V-  »k  +  3>k) 

where  2L  -  M  -  2w/A  and  A^  represent  a  discretization  and  f^  Is  an 

estimate  of  f(  •)  similar  to  that  of  b(*).  For  a  given  sample  of  size 

n,  let  the  bandwidth  of  the  weight  function  W.  in  f  (A)  be  A,  and  the 

bandwidth  of  the  weight  function  W_  In  b  (A,y)  be  A  ,  we  will  derive 

2  n  2 

the  asymptotic  Joint  distribution  of  the  a  'a  given  In  (2.9)  to  the 

•I 

first  order. 

It  Is  proved  In  Brllllnger  and  Rosenblatt  (1967)  that  if  for 

3 

1"1,2,  Aj  ♦  0  and  nA^  ♦  •  as  n  ♦  •,  then  asymptotically  as  n  ♦  •» 
fR( A^)  and  b^Aj.ji^)  are  Independent  normally  distributed  with 


▼ar(fn(Ak))  -  f2(Ak)  /  wj(u)du  Ak  *  0,ir  . 

Since  H  Is  a  function  of  b  ,  hence  H  and  f  are  asymptotically  inde- 
n  n  n  n 


pendent .  Let 


with 


Vk  ■ 


H  (.) 

W  -  VV  --V- 


and  observe  that  the  asymptotic  distribution  of  the  vector  (f  (X.), 

n  1 


H  (X.),  f  (X.),  H  <X4),  H  (»))  is  normal  with  mean  (f(X,),  h,(X,), 


n  £ 


n  j  n  J 


1 '  V 


f(X^),  h^Xj),  hj(*»  and  covariance  matrix 


where 


*i,i 

0 

a*,j  0 

0 

0 

0  *4,3 

t. 

t,K 

“j.t 

0 

*3  »j  ° 

0 

0 

*3.4 

°-  *3,3 

*3  ,» 

0 

t  . 
vtl 

0  **»3 

t 

*4.3  ’ 

Cov(f  ( X  ) ,f  ( X  )) 
n  t  n  j 

Vj 

-  Cov(H  ( X  )  ,H  (X4))  with  X 
n  %  ii  J  w 

-  X 

we  note  that  the  magnitude  of  sf  .  is  smaller  than  that  of  t 

*  tJ 


*.3 


An 


application  of  a  multivariate  6-method  (see  Bishop,  Fienberg  and 
Holland  [1975]  p.  493)  we  can  show  that  the  asymptotic  distribution  of 


(d.  .  ,d  )  is  bivariate  normal  with  mean 

*»*  j »■ 


where 


(f^KomUC  X^J+kX^)  2(  Aj  )Cos(Z(  Xj  HmXj  )) 


Z(Xt)  -  h^X^)  -  Xth jCrJ/x 


and  covarlanee  matrix 


C(A,k;i,k)  C(*,k;j,m) 

C(j,m;£,k)  C(J ,m;  J ,m) 

1  _1_ 

C(A ,k;  j  ,m)  -  f2(AJl)f2(XJ)  Sln(Z(  XA)+kXA)  • 

Sin(Z(XJ)-hBXJ){«ln(XJl,XJ)  -  xA\,/»}  (2.10) 

and 

K  "  /  W2^u,v^dudv 

V  j 

Using  this  and  a  straightforward  calculation,  tie  have  the  following 
theorem. 

Theorem  2.1.  Under  the  assumption  of  f  2.1  we  have  (a^  —  )  for 

k-1 . K  are  asymptotically  jointly  Gaussian  with  Means  zero  and  co- 

variances  given  by 

3  L  L 

“  -THTJ  J  W?(u,v)dudv  E  E  C(£,k; j  ,a)  (2.11) 

n  AgnC^  1"1  J-l 

where  C(£,k;j,m)  la  given  In  (2.10) 

He  will  now  assume  that  the  stationary  process  (xj  satisfies 

(1.6)  with  a  representation  given  In  (1.7)  such  that  a0  >  0.  As 

usual,  we  assume  P  (z)  and  Q  (z)  given  in  (1.5)  have  no  common  factor 
P  <1 

with  pq  ■  1  and  qg  >  0.  Under  these  assumptions,  equation  (2.11)  can 
be  used  to  estimate  the  variance  of  a^  with  f(X)  and  hj(X)  estimated 
by  fn(*)  and  Hn(\)  respectively.  These  results  can  be  used  to  deter¬ 
mine  the  smallest  Integer  k  such  that  Eafc  *  0.  He  then  relndex  the 
a^'s  and  change  their  signs  if  necessary.  This  gives  a  complete  pro¬ 
cedure  to  estimate  a^'s  In  equation  (1.7)  consistently.  He  use  these 
estimated  a^'s  to  Identify  and  estimate  the  polynomials  Pp(z)  and 
Q  (z)  by  the  C-table  and  the  Pade  tr  le  as  discussed  in  Lli  [1982] 

q 


K 


dealing  with  a  distributed  lag  model. 

3.  Asymptotics  of  the  C- table  and  the  Pade  approximant 


Given  a  pair  of  nonnegative  integers  q  and  p  we  denote  Pade 

*  j 

rational  approxlnants  to  a  formal  power  series  A(z)  -  £  a,zJ  by 

j-0  3 

[q/p]  -  Qq(*)/Pp(*)  where  Q^(z)  and  P^(z)  are  polynomials  of  degrees 

at  most  q  and  p  respectively.  We  assume  P  (0)  -  1  and  Q  (z)  and  P  (z) 

P  *1  P 

have  no  common  factors.  The  coefficients  of  Q  (z)  and  P  (z)  are 

P 

determined  by  A(z)  -  (Q  (z)/P  (z))  -  0(zp+<,+*).  The  following  three 

<1  P 

lemmas  can  be  found  in  Baker  [1975]. 

Lemma  3.1.  When  it  exists,  the  [q/p]  Pade  approximant  for  A(z)  is 
uniquely  determined .  Further 


Qq<*> 


det 


and 


Pp(z) 


det 


aq-p+i 

“q-p+2 

“q+1 

®q-p+2 

• 

aq-p+3 

• 

• 

*  *  *  “q+2 

• 

• 

• 

a 

q 

Vi 

a 

. « •  _ 
q+p 

<  j 

E  ai-n* 
>P  3  P 

*  j 

J-p-1  3  ^ 

q 

...  £  a, 

j-0  3 

aq-p+i 

aq-p+2 

•**  8q+l 

aq-p+2 

• 

aq-p+3 

e 

• 

•**  *q+2 

• 

e 

• 

aq 

Vi 

• 

a  . 
q+p 

«p 

zP_1 

...  1 

(3.1) 


(3.2) 


where  a^  ■  0  if  j  <  0  and  the  summation  is  set  to  zero  if  the  lower 
index  on  a  sum  exceeds  the  upper  index. 


-11- 


Given  nonnegative  integers  r  and  s,  we  define 

»  •  •  A 


r.s 


■  det 


ar-8+l  ar-s+2 


ar-s+2  ar-s+3 


r 

a(s-l) 
T 


rfl 


r+1 


r+s-1 


(3.3) 


(-1)  det[(ar+1_j)1  ^  .  J  • 

The  C-table .which  is  a  doubly  infinite  array,  is  defined  by 

C  *  (C  )**  n  .  He  further  define  C  _  -  1. 
r.s  r.s  *  0  r.O 

Lemma  3.2.  (i)  C  *  0  implies  that  [q/p]  exists.  (11)  Every  zero 

q.p 

•  1 

entry  in  the  C-table  for  a  formal  power  series  A(z)  -  1  +  £  a.zJ 

J-l  J 

occurs  in  a  square  block  of  zero  entries  and  is  completely  boarded  by 
nonzero  entries. 

Lemma  3.3.  Given  a  formal  power  series  A(z)  the  following  three 
conditions  are  equivalent 


(1)  A(z)  -  E  c  z^/(l  +  E  d  z^) 

j-0  3  J-l  3 

(2)  [q/p]  ■  A(z)  for  all  q  J>  t  and  p  >.  m 

(3)  C  *  0  and  C  -  0  for  all  r  >  l  and  s  >  m. 

q.p  r.s 

If  condition  (3)  in  Lemma  3.3  is  satisfied,  we  call  the  entry 

(£+1,  m+1)  in  the  C-table  the  “breaking  point”. 

Lemmas  3.1,  3.2  and  3.3  lead  to  the  following. 

Theorem  3.1.  The  process  {x^}  given  in  (1.7)  is  ARMA  (p.q)  given  in 

(1.6)  if  and  only  if  the  C-table  associated  with  A(z)  has  the  breaking 

point  (p+l,q+l).  Further  C  SO  and  the  coefficients  of  P  (z)  and 

q.p  P 

Q  (z)  in  (1.6)  are  obtained  from  (3.1)  and  (3.2).  To  normalize  these 
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coeffldents  we  divided  both  P  (*)  and  Q  (a)  by  C  so  that  p_  -  1. 

P  q  q,p  0 

Whether  the  roots  of  Q  (a)  are  Inside  or  outside  of  the  unit  circle  is 

q 

immaterial  here. 

This  theoren  provides  a  consistent  procedure  to  identify  the 
model  by  determining  the  orders  p  and  q  and  to  estimate  the  parameters 
of  the  identified  model.  We  use  the  a  ' s  obtained  from  (2.9)  to  con- 

J 

struct  estimates  C  of  C  ,  ascertain  the  breaking  point  in 
r*s  r,s 

C-table  to  identify  the  model  and  finally  by  substituting  the  a^'s 
for  *j'8  in  0*1)  and  (3.2)  to  obtain  estimates  of  the  coefficients  of 
Pp(a)  and  Q^(z) .  The  following  lemmas  can  now  be  proved  with  simple 
modifications  of  the  proofs  given  in  section  4  of  Lll  [1982]. 

Lemma  3.4.  If  are  asymptotically  jointly  Gaussian  for  a  fixed 

1C 

integer  K  with  mean  {*j }j_i  and  covariance  matrix  Z(CQ)  where 

■  n  *  +  0  6  >  0  «i  the  sample  slse  n  ♦  •  then  the  asymptotic  dis¬ 
tribution  of  R,  the  determinant  of  an  M 41  matrix. 

R  -  det  [(a^  j)^  with  a^  ^  e  {a^}^.  Gaussian  with  mean 

R  -  d.t  j.,J 

and  variance 
2  t  t 

oR  “  G£(Cn)G  where  G  is  the  transpose  of  G  ■  (gj»»..»gg)  with 

We  note  that  computationally  g^  is  the  sum  of  the  cofactors  of  a^  in 
the  matrix  l<*if j.j ]• 
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Theorem  3«2.  If  the  eetlaatee  of  {a^ }  In  (1.7)  are  given  by  {a^  } 
obtained  from  (2.9),  then  for  fixed  r  and  a, 

*  -  1,11  x8  1 


C  -  (-1)* 
r,a 


det  ^*r+i-J)i,J-l^ 


ia  asymptotically  normally  diatributed  with  mean  C  given  in  (3.3) 

r  ,s 

and  variance  GIG’  where  G  ■  »•  •  •  .gy)  with  L  -  r-s+l, 

3  a  a 

U  ■  r+a-1 ,  g4  ■  -r—  C  and  I  ia  the  covariance  matrix  of  (a_ 

j  rjS  L  u 

from  (2.11). 

A 

This  theorem  gives  a  method  to  construct  the  C-table  and  to  find 
the  breaking  point  (q+1 ,  pfl).  If  the  breaking  point  can  not  be 
uniquely  determined,  the  C-table  will  reduce  the  number  of  possible 
competing  models  to  only  a  few  for  further  testing.  If  the  process 
{Xfc }  does  not  have  a  rational  frequency  response  function  [q/p],  the 
C-table  will  still  suggest  a  possible  ARMA  (p,q)  approximation  to  A(s) 
using  the  principle  of  parsimony.  Once  we  have,  identified  the  model 
to  be  ARMA  (p,q),  replacing  the  *j'8  &T  their  estimates  a^'s  in  equa¬ 
tions  (3.2),  we  obtain  estimates  and  q^  of  p^  and  q^  respectively 


Qq(*)  9o"^l*  +  •••  + 

p^+pj*  +  ...  +  Pp*P 


with 


A  A  A  fl 

V^i*  •••  +  V 

1  +  p.s  +  ...  +  p  *p 
*  p 

pi  -  C  SO 
0  q,p 


(3.A) 


pi  "  pi/po  1  "  0*1 . . 


$i  "  *i/po  1  "  °*I« 


(3.5) 


To  ottaln  the  asymptotic  distributions  of  p^'s  and  q^'s  *  evaluate 
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the  determinant  Id  (3*2)  by  cofactor  expansion  of  the  last  row 
(sP,.*-1 . 1)  and  we  obtain 


P  (*)  •  Xq  -  AjS+XjS2  +...+  (-1)PA  *P 


(3.6) 


where  is  the  cofactor  of  Z 1  in  (3.2). 
Similarly,  we  have  frost  (3.1) 


V*>  ■  -  MJ/j-i*1)  +"  +  ('1)P*p(jVj-p,J) 


A  /*  ^A  A  A  A  ^  A  A  QA  A.  Q 

*0*0  +  (,lV,oV‘  Uq^0  ♦•••♦  <_1)  •q-pAP>* 


*  *  A  A 

Ba  4-  B.t  ♦...+  B  sM 

U  1  <| 


(3.7) 


Using 


3.4  and  equations  (3.4)  -  (3.7)  we  can  prove 


Theoree  3.3.  For  fixed  p  and  q,  let  L  •  nax{o,q-p+l}  and  U  -  q+p-1 . 


Then  the  asynptotlc  distributions  of  (p^-pj .pj-pj),  (pj-pj,qj-qj)  and 
(qj,-q|  ^j-qj)  are  each  bivariate  nornal  with  naan  (0,0)  and  covariance 


aatrlcas 


where 


PP  .  f'l.l.D,  ,t  t  s 

£i.J  i  n  T..UlFi,L,U,PJ,L,UJ 

1^  m  f  r  fp*  A*  ) 

‘•J  S.L.U 

m  f  r  fij*  q*  ] 

£i,J  lQ«  .  J  £L,Ut9i,L,U,9J,L,U' 
j  »“»w 


*i,L,U  "  1  *  *  *  * **U^  i"0,...,p 

9j,L,U  "  j"0».*..q 


with 


and 


hmjrtAt  *“L . u 

h'-x-ft  ‘-1 . “ 


IL  U  -  Cov(«L,...,a0)  from  (2.11). 

A  and  B  are  the  theoretical  values  of  A  and  B  respectively  In 

XX.  I  A 

(3.6)  and  (3.7).  Furthermore,  the  asymptotic  distribution  of  p^-p^ 
and  q^-q^  are  normal  with  mean  aero  and  variances 


1 


4.  Examples  and  Discussion 

Examples  In  this  section  are  simulated  according  to  the  model  of 


the  form  P  (B)X„ 
P  t 


C^(B)et  with 

Pp(B)  -  1  +  PjB  +...+  ppBP 


and 


«,<»>  -flo  +  i,**-”*  v’  qo >  0 

P  (a)  *  0  when  laj  <  1  . 


The  Innovation  process  are  obtained  from 


where  e^  ere  independent,  identical,  exponentially  distributed  with 
p  -  Ee’  »  1  and  o2  ■  Var(e’)  -  1.  Hence  Ee  -  0,  Var(e  )  -  1.  The 

C  w  tv 

sample  size  for  la  640.  Some  computational  details  are  discussed 
in  111  and  Helland  [1981]  and  Ill  and  Rosenblatt  [1982]. 


Example  1. 


Q2(B)  -  1  -  0.6B  +  0.8B 
Pj(B)  -1  +  0.6B 


All  the  roots  are  outside  of  unit  circle.  Table  1  gives  the  C-table 
associated  with  this  model.  Each  entry  has  two  numbers,  the  upper  one 

A  a 

is  C  and  the  lower  one  is  the  estimated  standard  deviation  of  C 
r,s  r,s 

computed  from  Theorem  3.2.  We  also  exhibit  table  2  which  gives  the 

ratio  of  the  C  and  its  estimated  standard  deviation  of  each  entry 
r,e 

in  table  1.  We  call  table  2  the  "resolution  table"  of  table  1.  It  is 
much  easier  to  recognize  the  pattern  in  a  resolution  table  when  there 
is  a  sudden  drop  of  resolution  at  entry  (£,m)  and  thereafter  (i,m)  is 
likely  to  be  the  breaking  point.  From  table  2,  it  is  clear  that  (3,2) 
is  the  breaking  point  and  the  model  is  correctly  identified  as  ARMA 
(2,1).  The  Fade  approxlmant  (2/1)  gives,  from  (3.4)  and  (3.5), 

Q.(B)  -  1.068  -  0.585  B2  +  0.763  B2 

2  (0.446)  (0.212)  (0.097) 

and 

P,(B)  -  1  +  0.594  B 
1  (0.092) 

where  the  numbers  in  the  parentheses  are  estimated  standard  deviations 
from  theorem  3*3. 

Example  2.  In  this  example  both  roots,  -0.5  and  -0.75,  of 

Q2(B)  -  1  +  3.5B  +  3B2 
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are  inside  of  the  unit  circle  while  the  roots  of  P2(B)  -  1  +  0.35B  + 
0.5B  are  outside  of  unit  circle*  The  associated  C- table  is  table  3 
and  its  resolution  table  is  table  4.  It  seens  reasonable  to  identify 
the  aodel  to  be  ARMA(2,2)  with  breaking  point  at  (3,3).  The  Pade 
approxlaant  (2/2]  gives 

Q2(B)  -  0.907  +  3.64  B  +  2.86  B2 

(0.94)  (13.7)  (10.5) 

and  (4.1) 

P2(B)  -  1  +  0.55  B  +  0.53  B2 
(0.60)  (0.62) 

The  large  estimated  standard  deviations  in  Example  2  may  be  due 
to  the  complicated  formula  in  Theorem  3.3  and  the  number  of  parameters 
are  large  relative  to  the  sample  size.  Nevertheless,  the  estimates  of 
the  parameters  provide  good  startlqg  values  for  possible  more  effi¬ 
cient  Iterative  methods.  He  note  that  the  usual  Iterative  type  of 
fitting  procedure  can  be  used  here.  He  can  deconvolve  the  process  X£ 
and  estimate  the  innovation  process  e£  by  e^.  Diagnostic  checking  can 
be  performed  on  e^  to  discriminate  among  possible  competing  models. 

The  probability  distribution  or  density  function  of  e^  can  be  esti¬ 
mated  to  facilitate  a  non-Gauss lan  maximum  likelihood  estimation.  It 
seems  that  in  building  a  finite  parameter  ARMA  model  of  a  stationary 
time  series  fx^},  one  should  use  the  procedure  suggested  in  Lil  and 
Rosenblatt  [1982]  to  deconvolve  X£  and  see  if  {e£}  is  near  Gaussian  or 
not.  If  not,  one  should  use  the  procedure  suggested  in  this  paper  to 
build  the  ARMA  aodel  without  imposing  the  Invert lbillty  condition. 
Alternatively,  one  may  want  to  use  any  one  of  those  methods  mentioned 
in  the  introduction  section,  using  mainly  the  second  order  structure, 
to  identify  the  orders  of  the  aodel;  however  one  ehould  still  use  the 
Pade  approxlaant  to  estimate  necessary  coefficients  and  to  identify 


whether  the  roots  lie  Inside  or  outside  the  unit  circle.  Even  in  the 
Gsussisn  esse,  one  nay  went  to  first  fit  en  MA(K)  for  e  moderate  inte¬ 
ger  K  (ssy  15).  Then  following  the  procedure  in  section  3,  one  can 
identify  the  equivalent  parsimonious  ARMA(p,q)  model  and  obtain  esti¬ 
mates  of  parameters.  As  s  comparison,  we  employed  the  usual  Box- 
Jenkins  type  estimation  procedure  as  it  is  Implemented  in  the  sub¬ 
routine  FTML  of  the  International  Mathematical  and  Statistical  Library 
(ISML) •  Given  the  right  orders  in  the  model,  we  obtain  estimates 

02(B)  -  1.0  +  1.161B  +  0.3027B2 

and  (A. 2) 

P2(B)  -  1.0  +  0.3307B  +  0.4789B2 
with  estimated  white  noise  variance  o^  ■  8.765. 

Using  Q2<B)  in  (4.2)  to  interprets  the  model  may  be  quite 
different  from  that  of  using  02(B)  in  (4.1). 

Example  2  shows  that  we  can  discriminate  models  which  ere  Indis¬ 
tinguishable  using  only  second  order  properties.  The  method  proposal 
in  this  paper  produce  estimates  that  are  consistent.  For  moderate 
sample  else  this  method  can  be  a  valuable  tool  for  AKMA  model  identi¬ 
fication  and  estimation. 
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